DOCOaEHT SESDHE 

PS 008 OifO 

Siegler^ Eobert $• 

Utility of Interactional Strategies in the Study of 
Formal Operations Reasoning, 
Apr 75 

16p.; Paper presented at the Biennial ^5eeting of the 
Society for research in Child Development {Denver, 
Colorado, April 10-13, 1975) 

MF-'$0.76 HC-$1.58 Plus Postage 
Abstiract Reasoning; *Adolescence ; ^Childhood; 
s*Cognitive Development ; ^Comparative Analysis; 
Interaction; Logical Thinking; ^Methods; Research 
Methodology; Test Interpretation; Validity 
♦Interact ional Strategies 



This paper argues /in favor of using interactional 
strategies in the study of f ormal^^operations reasoning. Interactional 
designs allow a convergent approach to specifying processes 
underlying the interaction of variables. In contrast, current 
methodologies contain two inherent disadvantages: they have limited 
utility in specifying the processes underlying development, and their 
results are difficult to interpret. Interactional strategies were 
used in the design of two experiments on the development of formal 
operations competencies. The r^esults of these experiments suggest 
that applying interactional strategies to the study of formal 
operations growth allows direct comparison between the strengths of 
existing age-related performance differences and the strengths of the 
e^Cperimentally manipulated treatments. This research Resign may also 
reveal catching up and readiness interactions that 6ould result in 
new interpretations for developmental differences, allowing precise 
statements as to the nature of the interaction of maturational and 
experiential factors which determine formal operations development. 
(GO) 
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There is widespread theoretical agreement that the acquisition of formal oper- 

ir 

ations reasoning is dependent upon the Interaction of maturational and experiential 
factors. Yet the designs of the large majority of studies in the area preclude dis- 
coveries concerning the nature of such interactions. In this paper, I would like to 
argue in favor of increased use of interactional designs, particularly those con- 
currently varying age and experiential factors. 

Interactional designs are hardly a new idea; they are routinely described in 
undergraduate methodology texts (e.g., Meale Pr Liebert, 1973). Yet such designs are 
remarkably rare in the licerature on cognitive development. Br^inerd and Allen 
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(1971), in reviewing conservation induction studies, cited only a single instance in 
which children of different ages wei*^ observed tmder instructed and uninstructed 
conditions in the same experiment. Similarly, Neimark (1975) cited but a single 
^^.>^ study of this type in the area of formal operations. 

The paucity of interactional designs may be best understood from the vantage 
^ point of the type of ouestions that most current studies seek to answer. In the 

C v». majority of studies of cognitive development, one of two basic questions is posed; 
*i ♦ 

each is linked to a distinct methodology. The first question concerns the changes 
that occur in untutored performance with age; the nethodologv used to answer such 
questions involves examining changes in knowledge on a task over an age range or as- 
sessing interrelationships among performance on several tasks over the age span. 
Examples of this strategy include LovelTs (1061) study of formal operations tasks, 
Elkind*s (1961) study of conservation problems, Tomlinson-Koascy fi Kcasey's (1974) 
work on the relationship between cognitive and moral development, and 
ERIC '^I'ainerd's (1973) study on tbe i !» m ); 2 



order of acnuisition of transivitv, conservation, and class inclusion skills. The 
second typical auestion in the cognitive developmental literature might be nhrased 
**Can children this yomg master this skill after having this type of experience?" 
The usual methodology is to compare the effects of various training techninues on 
children of a particular age. Examples include Gelman's (1969) study of conservation 
of length and number, Brainerd and Allen's (1971a) study of the density problem, and 
my o\m stuHy, with Bob and Diane Liebert, of the pendulum problem (Siegler, Liebert, 
fi Liebert, 1973). 

Each of these two strategies has advantages; however, like all methodologies, 
they are limited in the range of questions they can answer. One problem is that 
neither gives direct information on the relative responsivity to instruction of 
older and younger children. This can lead to substantial misinterpretation. For 
example, Brainerd and Allen (1971b) on the basis of existing studies, concluded that 
kge '-'as not substantially related to ability to benefit from conservation instruction 
In some studies, four-year-olds had been taught to conserve; in others, seven-year- 
olds had not benefited from instruction. I^oweVer, in the only two conservation in- 
duction studies tbat I Know of in n^bich older and younger children were provided the 
same draining, the older children benefited more (^'ingsley Pi Hall, 1967; Siegler 
Liebert, 1L^72). At the verv least, these two studies raise ouestions about the con- 
clusion derived by Brainerd nnd Allen from the non-interactional studies thpy re- 
viev/ed, - ^ ' 

A second disadvantage of the two prevalent strategies involves their relative 
lack of utility in specifying th'e nrocesses underlying development. Fven if it is 
learned that all' children master the pendulum problem before the balance scale task 
(or vice versa), the finding says little about the processes underlying mastery of 
either task, not even that the nrocesses are related. Nor am I aware of any at all 
specific models of ho^s^ the processes underlying mastery of a particular Piagetian 
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nroblem are related to those unHerlyinp mastery of other such tasks. The confusion 
engendered by these normative studies is illustrated by the directly opposing pre- 
dictions dram by researchers usin«» the same (Piagetian) model, concerning the order 
of acquisition of such skills as conservation, class inclusion, and transitivity 

Ccf. Brainerd, 1973). 

It 

The difficulty with training studies is more subtle. Such investigations may 
nominate various factors such as equilibration, reversibility, or modeling as important 
in the normative process, since they demonstrate that particular types of instruction 
can produce knowledge in non-knowers. However, it remains possible that such methods 
would also produce gains in those whose knowledge was relatively sophisticated already 
Vol cAampic, instructions to rehearse might improve the recall performance of younger 
children, but this would not very strongly implicate rehearsal as a process underlying 

developmental differences in recall memory unless it could also be shown that older 

f 

children, similarly instructed, benefited le?s. 

This last arjoiument thrusts me into the main tonic o^ this paper, the advantages 
of interactional designs, Tl.ore are two main types of interactional methodologies, 
concurrently varying either age and experiential or age and situational factors- 
I vnll only be discussing the former type, but most of the argunients apply in 
slightly modified form to the latter as v/ell. 

Simply stated, the most valuable feature of interactional designs i^bat they 
allow the uncovering of interactions. Consider two patterns of results that might 
emerge from designs simultaneously varying pn.' orf-rienti-^l factor?. could be 

labeled a ''catching up^* effect. If young children lack a particular skill that older 
ones possess, the effect of teaching the skill might be to narrow gaps in performance. 
Such patterns have emerged in the serial recall literature; the serial recall ner- 
formahcc of younger children improves ''hen they are encouraged to use organizational 
strategies, v;hil^ older children, alroadv organizing, n^e not as greatly affected 
by the instruction (e.g., Harris Burke,y 1972). This does not prove that increasing 
use of organization causes developmental increments in recall, but it does provide 
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relatively high quality evidence that it or sone functionally related competence is 
involved in the groirth. 

A second revealing: pattern of results occurs when differences between younger 
and older children become greater as a function of identical iiistruction. This is 
a relatively precise experimental analog to the often murky developmental concept of 
readiness. Older children may possess capabilities and knowledge that are relevant 
but insufficient to generate complete problem solutions* In such cases, instruction 
may integrate existing knowledge, provide the final pieces in the puzzle, and thus 
spur relatively large increments in competence. Younger children, not as ''ready,** 
may not benefit to as great an extent from the identical instruction. 

The benefits of the interactional strategv extend beyond the stage of em- 
pirical discovery, for inherent in the strategy's logic is a convergent approach to 
specifying processes underlying interactions. The first step is formulating an ex- 
planatory h>'pothesis; quite precise hypotheses may be suggested if several instruc- 
tional factors have been varied in an additive or factorial manner and some combin- 
ations have yielded interactions with age and others have not. Once formulated, there 
are at least two ways of verifying the hypothesis. One involves the standard of 
predictive validity; if the designated process is in fact central, independent as- 
sessment of it should prove superior to age as a predictor of success on the original 
task. A second verification technique involves direct manipulation of the factor. 
If the key process has been identified, either improving children's proficiency on it 
through training or changing the task to eliminate the need to perform it should re- 
duce developnental differences. Thus, the converger^- strategy may allow for more 
rigorous specification of processes underlying cognitive development than is typical, 

I have used interactional strategies in two recent experiments on the develop- 
ment of formal operations competencies, specifically the development of scientific 
reasoning. The first (Siegler fi Liebert, 1975) concerned the ability to design a 
fully factorial experiment; the second (Siegler 5 Atlas, 1975) was, fittingly enough. 
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In the first experiment, 10- and 13-year olds were presented the task of makiiiE 
an electric train run. . "o do this, thov needed to find t'^c "correct" 
setting of four s'.dtches, each of which could be set either up or down. Actually, 
there was no single correct setting; the train was controlled by a foot pedal hidden 
underneath the experimenter's desk. Tims, to solve the problem, children needed to 
generate all 16 possible combinations (the eauivalent ofa2X2X2X2 factorial 
design, if the four switches are viewed as factors, and up and do^-n as their levels). 

Prior to attempting the train problem the 10- and 13-year-olds were provided 
either a conceptual frameworl: and two analog problems, the conceptual framework alone 
or no special training. The conceptual framework included explanations of the con- 
cepts of factors and levels and a description of an algorithm for generating tree 
dia'grams and thereby identifying all of the possible solutions to problems. The 
anilog p^ems provided trial runs for applying the concepts; children solved pro- 
blems simila\ in form but different in content from the train problem. 

/ The results of the experiment were clearcut (Table 1). Performance proved 
ouite plastic^ type of training accounted for 47% of the total variability in the 
data, age for 14%, and the interaction of the two factors ^^or 4%. Without training, 
fifth and eighth graders performed very similarly; only one eighth and no fifth 
grader generated all 16 possible combinations in 16 trials. Provided both conceptual 
framework and analog problems, fifth and eighth graders again performed similarly; 
all 10 of the eighth graders and 7 of 10 fifth graders produced perfect factorial 
arrays. However, given conceptual framework alone training, the performance of the 
older children substantially exceeded that of the younger ones; relative to their 
uninstructed age peers, eighth grader.s benefited from the instruction while fifth 
praders did not. Thus, the interaction conformed to the readiness pattern described 
above . 



The task then became to sneci^'v what accounted for the differential decrees of 
readiness of older and vounger children to benefit from tho concentual framework 
alone instruction. ^ clue Was provided by the finding that children's pattern of 
record keeping closely paralleled their pattern of success on the task (Table 2). 
All children had been encouraged in the instructions to record their responses with 
pencil and paper; they were told th^t the train problem mipht be difficult and that 
record keep inti could reduce its difficulty. However, not all children accepted the 
advice; whether or not they did so proved to be hi^^hly correlated with the total 
number of combinations they generated (r^^ = -64). Thus record keePinR appeared to 
be an important mediating, device in children's combinatorial performance. Alon^ 
with other evidence, this suggested that the differential reaction to the conceptual 
framework alone instruction was due to differential ability of 10- and IS-year-olds 
to anticipate the possible complexity of the problem. Newell and Simon (1^72) des- 
cribed sucb differences as nertainine to the ability to set up the problem snace; 
in everyday parlance, the process is somewhat akin to -^^oresiqht . ^'^e are currently 
testing the foresif^ht inten-^retation by examininj;^ the performance o^ children when 
the need for foresif^bt on the problem is eliminated; by the logic of the readiness 
interaction, if foresir:ht is the key factor, the manipulation should reduce or 
eliminate the developmental difference. Perhaps the most important point, thoujih, 
is that the interpretation and the subsequent experiment v'ould not have arisen ex- 
cept in the context of the interactional design. 

The second experiment concerned children's understanding interactional pat- 
terns in data. Ten- and 13-vear-olds '*ere shown data sheets (Table 31 that were 
analogous to the settings of the switches in the train problem. They \.'ero told that 
their job ^•as to figure out which two of the three switches determined how fast the 
train would go. That is, t>»e way that the tv»o important switches v;ere set--down and 
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down, dovm and tin, up aPd do^it, or un and up- -would detcrr^in^^ the train's speed; the 
children needed to ^ind out hm*. Mo nenory or tine restrictions were present; child- 
ren were Riven as much time as they wanted to solve the problems and were encoura^?.ed 
to write their solutions on another piece o^ paner. Then thev were presented the 
combinations, in a different order, and asked to fill in the proper speeds (Table 4). 
Four tyvQS of interactional patterns w^re studied: additive, iP \/hich both switches 
dovm made the train ro ^ast, either one doim made it p,o slow, and neither dovm not at 
all; catalvtic, in which both down meant fast and any other pattern not at all; 
terminative, in which either or both doHTi meant slow and neither meant not at all; 
and antacjonistic, in which both down meant slow, one but not the other dovm meant 
fast, nnd neither doKP m^^nt not -it all. 

Ti.«tnin>* r*^n.^ir>tcd o*" tv/o parts: a conceptual framework that provided a reneral 
strategy fur solvipf^ the problems and ^nidr^d in*;ti'u*^tion on the <^irst o-f the four 
tasks. The tralinnfj followctl <Hrt'crlv from i flow diaf^ram model of the renuisitcs 
for solving the tasks (Fipure 1). A balanced Latin Square Desifjn v/as used sq that 
each type of problem appeared eaually often in each position of the four problem 
-^enuence and an enual number of times directly -FollowinR each of the other types of 
problems . 

In the first part of the experiment, ^^hich is the only one directly pertinent to 
this discussion, fiftb and eijfrhth ^^raders were observed either instructed or unin- 
structed. A basically interactive pattern was observed, this time a catchinp:-up 
interaction. Amonp uninstructcd children a clear developmental difference was pre- 
sent : older children solved 65% of problems perfect Iv compared to 22'' perfect 
solutions for voun^icr children. In addition, 50^^ of the uninstructed 13-vear-olds 
solved all of thp test nrohlcms, i^ersus of the untutored I'^-venr-olds. <"dven 
ipstruction, hovjcx'cr, the developmental difference disawoared: the solution rate for 
older children ^^as 78^ versus 72'' for youn^^er ones, and of each group solved all 
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problems perfectly. The pattf?m stron.qly sugpested that the problem solving: strategy 
that v;as tauj[^ht was redundant v.ith knowledge that t^e eighth jrraders already^ had or 
could invent, while sinilar knowledpje was not possessed by fi^th j^raders. Thus, it 
appeared that understanding of the stratep.y underlay the developmental difference 
between uninstructed fifth._and eij^hth <Traders. The next step is to specify more 
Precisely the locus of the interaction. 

The results of these two experiments suRt^est that applyinr^ interactional strat- 
efjies to studying formal operiMons growth wUl prove fruitful. Such strategies 
allow direct comparison bet'^^een the strenj^ths of existing age-related performance 
differences and strengths of the experimentally manipulated treatments. They 
also may reveal catching up avd readiness interactions that in turn may su<Tgest nevj 
interpretations for developmental differences. Thus, increased reliance on this 
methodology nay enable us to go beyond the bland assertion that formal operations 
development results from an interaction of naturational and exT>eriential factors to 
'Tale preri«;e statements as to the nature of the interactions. 
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Table 1 



Pcrcentarre of rhildren Producinp All Possible Combinations 



Treatments 



Topceptual franevork 
alone 

Control 



lO'-year-olds 13-year-olds 



Concentual franevorl; 

vit^ analof^s 70 l^^O 



50 



10 
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Table 2 

Percentage of Children Keeping Written Pecords 



^ ^ ^ 10-year-olds 13-year-olds 

Treatments ^ 

roncentual frajriev^ork 

v'ith analoRS^"^ ' 90 - 100 

Tonceptual franerork '• 

alone 10 ?0 

rontrol 20 40 
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Table 3 
An Additive Interaction 



S'v'ITCH 1 q"'ITrH 2 SU'ITCil 3 TRAIN nORq 

Up Poim Hovm Slow 

Un Up Up Not at all 

Do™ Do\m Hovm Fast 

Un Dovm Up Slow 

Do^m Un Up Slow 

Hovm ?o\m Up Past 

no^m Up Dov;n Slov; 

Un Un Do"m Not at all 
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Table 4 

I 

Answer Sheet 

SV'ITCH 1 . SmTCU 2 SmiCH 3 TRAIN GOES 



Dov/n 


Un 


Down 




Up 


Voxm 


Un 




Down 


Do^m 


Down 




Down 


Dovm 


Up 




Up 


Up 


Down 




Up 


Doim 


Down 




Up 


lip 


Up 




Dovm 


Un 


Up 





'•/liich switches were important? 1^-2 1 3 2 fr 3 
The v/ay they worked was: 
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